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Abstract 

Characterizing the capacity region of multi-source wireless relay networks is one of the fundamental issues in 
network information theory. The problem is, however, quite challenging because the transmission of other sessions 
acts as inter-user interference when there exist multiple source-destination (S-D) pairs in the network. By focusing 
on a special class of networks, we show that the capacity can be found. Namely, we study a linear finite-field network 
with time-varying channels, which exhibits broadcast, interference, and fading natures of wireless communication. 
We observe that fading can play an important role in mitigating inter-user interference effectively for both single-hop 
\ and multi-hop networks. We propose new block Markov encoding and relaying schemes with randomized channel 

pairing, which exploit such channel variations, and derive their achievable rates. By comparing them with the general 
cut-set upper bound, the capacity region of single-hop networks and the sum-capacity of multi-hop networks can 
be characterized for some classes of channel distributions and networks topologies. For these classes, we show that 
\ the capacity of multi-source networks can be interpreted as the max-fiow min-cut theorem. 

I. Introduction 

Capacity characterization of general wireless relay networks is a fundamental problem in network information 
O | theory. However, the capacity is not fully characterized even for the simplest network consisting of single source, 
single relay, and single destination [1]. In wireless environments, a transmit signal will be heard by multiple nodes, 
i— ( ■ which we call the broadcast nature of wireless communication, and a receiver will receive the superposition 
of simultaneously transmitted signals from multiple nodes, which we call the interference nature of wireless 
communication. Furthermore wireless channels may be time-varying due to fading, and there is noise at each 
I/" - ) . receiver. Considering all these makes the problem vary hard. 

Hence, one of the promising approaches is to study simplified relay networks, whose results can provide insights 
f-- towards exact or approximate capacity characterization for more general wireless relay networks. Let us first look 
^ ■ at some cases that the capacity is known. For wireline relay networks or the relay networks with no broadcast 
q \ and no interference, routing is enough to achieve the unicast capacity [2]. On the other hand, routing alone cannot 
' achieve the multicast capacity and network coding has been shown to be optimal in this case [3], [4], [5], [6]. 
For deterministic relay networks with no interference, the unicast capacity has been characterized in [7] and the 
extension to the multicast case has been recently studied in [8]. The multicast capacity of erasure networks with no 
' interference has been also characterized in [9]. When there is no broadcast, the unicast capacity of erasure networks 
has been characterized in [10], which is the dual network studied in [9]. For all these mentioned networks, the 
unicast or multicast capacity can be interpreted as the max-fiow min-cut theorem. 

Notice that although such orthogonal transmission or reception is possible in practice by using time, frequency, or 
code-division techniques, it is suboptimal in general channels. Therefore, simplification of wireless relay networks 
while preserving both broadcast and interference natures is crucially important to capture the essence of wireless 
communication. The simplest model that successfully reflects both broadcast and interference natures might be 
linear finite-field relay networks [11], [12], [13], where a node transmits an element in the finite-field and receives 
the sum of transmit signals in the same finite-field. Recently, the work in [13] has shown that the max-fiow min-cut 
theorem also holds for deterministic linear finite-field relay networks. After the capacity characterization of linear 
finite-field relay networks, the approximate capacity of Gaussian relay networks has been characterized within a 
constant number of bits using the quantize -random-map-and-forward by the same authors [14]. 
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In spite of the surging importance of multi-source relay networks, capacity characterization is much more 
challenging if there exist multiple source-destination (S-D) pairs in a network. Even for linear finite-field relay 
networks, the extension of the results in [13] to the multi-source does not seem to be straightforward. Notice 
that the main difficulty arises from the fact that the transmission of other sessions acts as inter-user interference 
and, as a result, the cut-set upper bound is not tight in general. Due to these difficulties, the existing capacity or 
approximate capacity results are limited in specific network topologies such as two-user interference channel [15], 
[16], many-to-one interference channel [17], two-way channel [18], [19], and two-user two-hop relay network [20], 
[21]. Therefore, one of the basic questions is whether we can characterize the capacity or approximate capacity for 
more general network topologies or other classes of relay networks. 

In this paper, we study multi-source linear finite-field relay networks with time-varying channels, which capture 
three key characteristics of wireless environment, i.e., broadcast, interference, and fading. Note that a random 
coding strategy, which is still optimal in single-source fading linear finite-field relay networks [22], [23], does 
not work anymore due to the inter-user interference. As mentioned before, a fundamental issue in multi-source 
networks is how to manage inter-user interference in a network. We observe that fading can play an important role 
in mitigating such interference efficiently, that leads to the capacity characterization for certain classes of networks. 
More specifically, for single-hop networks, inter-user interference can be removed completely at each destination 
by using two particular channel instances jointly. For multi-hop networks, by using a series of particular channel 
instances over multiple hops, each destination can also decode its message without interference. 

As an example, consider the three-user linear binary-field relay network in Fig. [TJ where G F2 denotes the 
information bit of the k-th source and the symbol in each node denotes the transmit signal of that node. For 
single-hop networks, as shown in Fig. [T] (a), by transmitting the same bit twice at each source through and 
H^ such that + = I, each destination can cancel interference by adding the two received signals, 
where and denote the two channel instances of the first hop and I denotes the identity matrix. Related 
works dealing with the inseparability of parallel interference channels can be found in [24], [25], [26], [27] and 
the references therein, where the idea of opportunistically pairing two channel instances, i.e., Hp + = I, 
also appeared in [26], [27]. This can be considered as a different and simpler way of doing interference alignment 
[28], [29]. For two-hop networks, as shown Fig. [T] (b), we notice that each destination can receive the information 
bit without interference if H2H1 = I, where Hi and H2 denote the channel instances of the first and second hop, 
respectively. Similarly the interference-free communication is possible for M-hop networks by opportunistically 
pairing the series of channel instances from Hi to Ha/ such that Hj/Hm-i • • • Hi = I, where H m denotes the 
channel instance of the m-th hop. 

Based on these key observations, we propose block Markov encoding and relaying schemes which make such 
opportunistic pairing of channel instances possible. By comparing their achievable rate regions with the cut-set upper 
bound, we characterize the capacity region of single-hop networks and the sum capacity of multi-hop networks for 
some classes of network topologies and channel distributions. 

This paper is organized as follows. In Section JIJ we define the network model and state the multi-source relay 
problem and the notations used in the paper. In Section [Till we derive the general cut-set upper bound, which 
will be used to prove the converses in Sections [TV] and [V] In Section [IVJ the block Markov encoding scheme 
is proposed for single-hop networks and its achievable rate region is derived, which characterizes the capacity 
region for certain classes of networks. In Section [V] the block Markov encoding and relaying scheme is proposed 
for multi-hop networks and its achievable rate region is derived, which characterizes the sum capacity for certain 
classes of networks. We conclude this paper in Section [VI] and refer the proofs of the lemmas to Appendices I and 
II. 

II. System Model 

In this section, we first explain the underlining network model and then define the achievable rate region and the 
notations used in the paper. Throughput the paper, A and a denote a matrix and a vector, respectively. The symbol 
A denotes a set and \A\ denotes the cardinality of A. 

A. Linear Finite-field Relay Networks 

We study a layered network in Fig. [2] that consists of M + 1 layers having K m nodes at the m-th layer, where 
m £ {1, • • • , M + 1}. Let us denote K miiX = max m {K m } and K m [ n = m.m m {K m }. The (k, m)-fh node refers 
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to the A:-th node at the m-th layer. Then the (k, l)-th node and the (k,M + l)-th node are the source and the 
destination of the A;-th S-D pair, respectively. Thus K = K\ = Km+1 is the number of S-D pairs. Notice that if 
M = 1, the network becomes a if -user interference channel. 

Consider the m-th hop transmission. The (i, m)-fh node and the (j, m + l)-th node become the z-th transmitter 
(Tx) and the j-th receiver (Rx) of the m-th hop, respectively, where i G {1, • • • , K m } and j G {1, • • • , K m+ i}. Let 
jij im [t] G F2 denote the transmit signal of the (i, m)-th node at time t and let yj, m [t\ G F2 denote the received signal 
of the (j, m + l)-th node at time t. Let hj^ m \t] G F2 be the channel from the (i,m)-th node to the (j,m + l)-th 
node at time t. The relation between the transmit and received signals is given by 

yj,m[t\ — ^ hj,i,m [^]^i,m [t] ; (1) 
i=l 

where all operations are performed over We assume time-varying channels such that 

PT(h jtit m[t\ = 1) =Pj,i, m (2) 

and hj^ m \t\ are independent from each other for different i, j, m, and t. Let x m [t] and y m [t] be the K m x 
1 transmit signal vector and K m+ i x 1 received signal vector of the m-th hop, respectively, where x m [t] = 

T r i T 

[t]] , ym[t] = [yi,m[t]r ■ ■ ,yK m+1 ,m[t]\ ■ Then the transmission of the m-th hop can be 

represented as 



y m [t] = H m [t}x m [t\, (3) 

where H m [t] is the K m+ i x K m channel matrix of the m-th hop having hj^ m \b) as the (j, i)-th element. We 
assume that at time t both Txs and Rxs of the m-th hop know Hi[t] through H m [i]. For notational simplicity, we 
use Pr(H m ) to denote Pr(H m [t] = H m ), where H m G Y^ m+lXKm . 
We will study the following class of networks in this paper. 

Definition 1: Let mo = argmin mg { 1 ... M y E(rank(H m ) jl. A linear finite-field relay network is said to have a 
minimum-dimensional bottleneck-hop rriQ if K m > K mo and K m+ \ > K ma+ \ (or K m > K mo+ i and K m+ \ > K mo ) 
for all m G {1, • • ■ ,M}. 

Notice that any networks having K m = K for all m G {1, ••■ ,M + 1} or any 1-hop or 2-hop networks are 
included in this class of networks regardless of channel distributions. 



B. Problem Statement 

Based on the previous network model, we define a set of length-n block codes. Let be the message of the 
fc-fh source uniformly distributed over {1,2,- •• ,2 nRk }, where Rk is the rate of the fc-th source. For simplicity, 
we assume nRk is an integer. Then a (2 nRl , • • • , 2 uRk ; nj code consists of the following encoding, relaying, and 
decoding functions. 

• (Encoding) 

For k G {1, • • • , K}, the set of encoding functions of the fc-th source is given by {/& it¥t=i '■ {1> ' ' ' > 2 nRk } —>■ 



F% such that 



x k ,i[t] = fk,l,t(W k ) for t G {!,-•• ,n}. (4) 



• (Relaying) 

For m G {2, • • • , M} and k G {1, • • • , K m }, the set of relaying functions of the (k, m)-th node is given by 
{fk,m,t}U ■ F£ - such that 

Xk,m[t] = fk,m,t (yfc,m-l[l], ' ' ' ,2/fc,m-l[* ~ 1]) for t G {1, • • • ,1%}. (5) 

• (Decoding) 

'We focus on the binary field F2 in this paper, but some results can be directly extended to F,j (see Remarks Q] and [2}. 
2 Since E(rank(H m [t])) is the same for all t, we use E(rank(H m )) to denote E(rank(H m [t])). 
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For k G {1, ■ • • , K}, the decoding function of the fc-th destination is given by g k : F£ — ► {1, • ■ ■ , 2 nRk } such 
that 

Wfc = 9k (Vk,M [1] , • • • ,Vk,M N ) • (6) 

If M = 1, the sources transmit directly to the destinations without relays. The probability of error at the A;-th 
destination is given by P^} = Pr(W k ^ W k ). A set of rates (R\,--- ,Rr) is said to be achievable if there 
exists a sequence of (2 nRl ,--- ,2 nRK ;n) codes with P^} — ► as n — ► oo for all k G {1, • ■ ■ , if}. Then the 
achievable sum-rate is simply given by i? sum = J2k=i ^fc- The capacity region is the convex hull of the closure of 
all achievable • • • , and the sum capacity is the supremum of all achievable sum-rates. 

C. Preliminaries 

In this subsection, we introduce the notations for directed graphs and define sets of channel instances and sets 
of nodes. 

1) Notations for directed graphs: The considered network can be represented as a directed graph Q = (V, 6) 
consisting of a vertex set V and a directed edge set 8. Let v kjTn denote the (fc,m)-th node and V m = {vk,m} k =i 
denote the set of nodes in the m-th layer. Then V is given by U m6 | lr . ,M+i}Vm- The sets of sources and destinations 
are given by S = V\ and V = Vm+i, respectively. 

There exists a directed edge (f j, m , fj, m +i) from v^ m to Wj, m +i if Pj,i,m > 0. For V' C V and V" C V, define 
£(V, V") as the set of edges going from V' to V" given by {(V, G V, t>" G V", (V, v") G 5}. We say node 

v' is connected to node u" if there exists a series of edges from v' to v", where we assume v' is always connected 
to itself v' . We further define v' is connected to v" under V" if there exists a series of edges in £(V', V) from u' to 
v". We define cut SI C V as a subset of nodes such that at least one source is in $7 and at least one corresponding 
destination is in S7 C . We define the following sets related to $7: 

K-n = {k\v kjl G SI, v k:M +i G Sl c , fc G {1, • • ■ , if}}, 

% = {^A:,M+l|& G /Cq}, 

Sn = {v k ,i\k G 

SI £> = {t>|£(S7, {«}) (f),v is connected to at least one of 

the destinations in Vq under ft c ,v G S7 C }, 
SI' = {v\At least one of the sources in Sq is connected to v,v G S7}, 

ns = Hf(M,n D )^^7;€n / }. (7) 

Let Ay/ [£] and 3V [*] denote the sets of transmit and received signals of the nodes in V' at time t, respectively. Let 
Hy,v"[*] be the \V"\ x |V'| channel matrix at time t from the nodes in V' to the nodes in V". Hence Hy mj y m+1 [£] = 
H m [i]. For notational simplicity, we use Hn[t] to denote Hn S: Q D {t] in this paper. 

2) Sets of channel instances and nodes: Suppose V' C V", V" C V", and G is a |V"| x |V'| matrix. We define 
the following sets of channel instances: 

Hvy (G, V', V") = {Hy )V "| H V',v» = G,Hy,y, G F> v " |x|v ' 1 }, 

<,V" (G, V, V") = {Hy )V "| H V',V» = G,rank(Hy,v») = rank(G), 

Hv,v" £ F^ v "' x ' v ''}. (8) 

Notice that ?iv',V" (G, V', V") is the set of all instances of Hy/ y» that contain G in Hp, y„. Similarly, 
Hy, v „ (G,V',V") is the set of all instances of Hy,v" that contain G in Hy y, and have the same rank as 
G. We further define the following pairs of node subsets: 

V(a,b,V',V") = {(V',V")||V'| = a,\V"\ =b,(V',V") C (V,V')}, 

V(Hy,y,) = {(V', V'OIIV'I = \V"\ = rank(Hy ; yO,rank(Hy y,) = rank(Hy )V ")> 

(V',V")C(V',V")}, (9) 

where a and b are positive integers satisfying a < \V'\ and b < \V"\ and we define V (Hy,v") = </> if rank(Hy/ ; y») = 
0. The set V(a, 6, V', V") consists of all (V', V") such that the number of nodes in V' and the number of nodes in 
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V" are equal to a and b, respectively. The set V(Hy,v") consists of all (V', V") such that Hy y, is a full rank 
matrix and has the same rank as Hy,y- 

III. Upper Bound 

In this section, we obtain a general cut-set upper bound then derive some useful rate upper bounds from the 
general bound, which will be used to prove the converses in Sections [TV] and [V] 

A. Cut-set Upper Bound 

In this sebsection, we show that any sequence of (2 nRl ,--- ,2 nRK ;n) codes with P^jj -> for all k satisfies 
the rate constraints in the following theorem. 

Theorem 1: Suppose a linear finite-field relay network. For a cut Q,, the set of achievable rates (R±, ■ ■ ■ ,Rr) 
is upper bounded by 

Y, Rk < E(rank(H n )). (10) 

keKn 

Proof: Let us define Wjc u = {Wk\k £ JCn}. We further define a length-ra sequence a" to denote [a[l], • • • , a[n]]. 
Then 

k&Kn 

= i(w K(1 ;y n (v n ),n n 1 ,--- ,n n M ) + H(w ICn \y n (v n ),n n 1 ,... ,n n M ) 

< I(W Ka ; y n (V n ),H.^ ■ ■ ■ , B. n M ) + ne n 
^I{W Kn] y n {V^)\Rl,... ,U n M ) + ne n 

( </(^ n ;y"(^)|H^--- ,n n M ) + ne n 

(d) 

< I(W,c n ;y n (n D )\x n (n-n'),U^--- ,U n M )+ne n 

< I(x n (n s ); y n (Q D )\x n (Q - W),H.^, ■ ■ ■ , H n M ) + ne n 

® F(y"(MI* n (^ - a'), H?, • • • , Hfc ) + ne n 

(9) ™ 

< 5^fT(i/(ni,)M|x n (n-n0 5 Hi[t],..- ,H M [i])+ne n 
t=l 

(h) 

< nE(rank(H n )) + ne n , (11) 

where e n > is an arbitrarily small constant satisfying e n — > as n — > 00. Notice that (a) holds from Fano's 
inequality, (6) holds since the messages are independent with the channel matrices, (c) holds since Wjc n — 
(y n (n£)),H™, • • • , H^-) - y n {T>n) forms a Markov chain, (d) holds since x n (f2 - Q') is independent with Wjc n , 
(e) holds since Wtc n - (x n (£ls), % n (Q ~ &■'), , • • • ,H^) - y n {Vt D ) forms a Markov chain, (/) holds since 
y n (^lf)) is a deterministic function of x n (Qs)> x n (f2 — iY), and H™, • ■ ■ , H^, (g) holds since conditioning reduces 
entropy, and (h) holds with equality if each element of x n (Qs) is uniformly distributed over F2. Therefore, we 
obtain ([TOl . which completes the proof. ■ 
Theorem [T] shows that the aggregate rate of the S-D pairs divided by a cut is upper bounded by the average 
rank of the channel matrix constructed by the cut. As an example, consider the cut in Fig. [3j where Q = 
{vi J i,V2 ) i,v 3> x,V2 l 2,V3,2,V3,3,v 3) 4}. Then we obtain V n = {f 1,4, 1^2,4}, $n = {vi,i,v 2 ,i}, &d = {^2,3^1,4}, 
= {v2,2, ^3,3}, and H n = [[^2,2,2, 0] T , [0, h lt3j3 ] T ] T . Therefore, Ri + R 2 is upper bounded by E(rank(H^)) = 

P2,2,2 +Pl,3,3' 

B. Rate Bounds for Single-hop and Multi-hop Networks 

In this sebsection, we obtain useful rate upper bounds from Theorem [T] which will be used to show the converses 
in Sections [TV] and [V] Let us first consider single-hop networks, that is M = 1. If we set f2 = {wjfc,i}, then 
2Zi£Kn R i = R k and H n[t] = h k)k) i[t]. Thus, we obtain 

Rk < Pk,k,i (12) 
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for all k G {1, • • • , M}, which coincides with the point-to-point rate of the k-th S-D pair assuming no interference. 
From (fT2~l ). the achievable sum-rate of single -hop networks is upper bounded by R sum < J2k=iPk,k,i- We will 
show in Section [TV] that (fT2l is achievable if Pk,k,i = 1/2 for all k regardless of the channel distributions of the 
interfering links, which characterizes the capacity region of such single-hop networks. 

Let us now consider multi-hop networks, that is M > 2. For general multi-hop networks, we set 12 = U« m Vi, 
where m G {1, • • • , M}. Then, from J2k£K n ^ = -^sum and Hn[t] = H m [t], we obtain 

R snm <minE(rank(H m )) (13) 

m 

for all m G {1, • • • , M}, or equivalently i? S um < F(rank(H mo )). We will show in Section [V] that if the network 
has a minimum-dimensional bottleneck-hop and the channels are uniformly distributed, the above sum-rate bound 
is achievable, which characterize the sum capacity. 



IV. ACHIEVABILITY FOR SlNGLE-HOP NETWORKS 

In this section, we propose a transmission scheme for single-hop linear finite-field networks and derive an 
achievable rate region when we apply the proposed scheme. As mentioned in Introduction, each source can transmit 
one bit without interference by using two instances and jointly if 

+ Hj 2) = I. (14) 

The proposed block Markov encoding makes such pairing possible. As a simple example, we first study 2-2 networks 
and then extend the results of the two-user case to general K-K networks. 



A. 2-2 Networks 

Consider the 2-2 network with Pj ; i ; i = 1/2 for all i and j. Fig. [4] (a) shows 16 possible instances of Hi[t] 
that are equally distributed, where the dashed lines and the solid lines denote the corresponding channels are zeros 
and ones, respectively. The symbols in the figure denote the transmit signals of the sources and the nodes with no 
symbol transmit zeros, where s& denotes the information bit of the k-th source. If we use each instance separately 
as shown in Fig. [4] (a), then R sum = j| is achievable. However, one can use some instances jointly as shown in 
Fig. H] (b) to improve the achievable sum-rate to 1. More specifically, R± = R 2 = 1/2 are achievable. In the first 

case, for example, each source can transmit one bit using = [0, 1] T , [0, 0] T and = [1, 1] T , [0, 1] T | 
jointly. Because the first destination receives the interference bit S2 and the interference-added information bit 
s\ + S2 separately, it can decode the intended bit. Whereas if we use these two instances separately, then only 
one of the two sources can transmit one bit. Since the cut-set bound in (fT2l shows R^ < 1/2, this simple scheme 
indeed achieves the capacity region. 

Based on this key observation, we will obtain an achievable rate region for general single -hop networks in the 
next subsection, which provides the capacity region when pk,k,i = 1/2 for all k G {1, • • • , K}. 



B. General Single-hop Networks 

Now consider the achievability for general single-hop networks. We assume the symmetric rate for all S-D pairs, 
that is R\ = • • • = Rk = R- Similar to 2-2 networks, each source can transmit one bit by transmitting the same bit 
over two channel instances satisfying + = I. The following block Markov encoding makes such pairing 
of channel instances possible. 

1) Block Markov encoding: Let us first divide a block into two sub-blocks having length n/2 for each sub- 
block. Define 7"M(Hi) as the set of time indices of the 6-th sub-block whose channel realizations are equal to 
Hi G Ff xK , where b G {1, 2}. We further define 

n(Hi) = re#min{Pr(Hi), Pr(Hj + I)}ci -1 , (15) 



where 



= Yj min{Pr(Hi),Pr(Hi + 1)}. 



(16) 
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Notice that (T^Hi)! is random depending on the channel realizations but n(Hi) is a deterministic function of 
R. Each source will transmit Ylu "-(Hi) bits during n channel uses or two sub-blocks. From (031 ) and (fT6l ). we 
can check that R is equal to J2n n (Hi). 

The detailed encoding is as follows, where for simplicity we assume n(Hi) is an integer. 

• (Encoding of the first sub-block) 

For Hi G Ff xK , if |7~M(Hi)| < n(Hi) declare an error, otherwise each source transmits n(Hi) information 
bits using the time indices in 7"W(Hi). 

• (Encode of the second sub-block) 

For Hi G Ff xK , if |7~[ 2 ](Hi + I)| < n(H a ) declare an error, otherwise each source retransmits n(Hi) 
information bits that was transmitted during 7~M(Hi) using the time indices in 7~[ 2 ](Hi + 1). 
Let Sfc(i) denote the i-th information bit of the k-th source, where i = {1, ■ • ■ ,nR}. Let t\(i) and £2(2) denote 
the time indices over which Sk{i) was transmitted. Then the detailed decoding is as the follow. 

• (Decoding) 

For i G {1, • • • ,nR}, the k-th destination sets Sk(i) = Uk,i[ti(i)] + 2/fc,i [^2 («)] - Then estimate based on 
nR estimated bits. 



C. Achievable Rate Region 

In this subsection, we derive the achievable rate region of general single-hop networks by applying the proposed 
scheme. 

Let E^ denote the event such that |7~M(Hi)| < ra(Hi) for any Hi and E^ denote the event such that 
|T[ 2 l(Hi + I)| <n(Hi) for any Hi. The following lemma shows that, there is no error if (E^ U E^) c occurs. 
Lemma 1: Suppose a linear finite-field relay network with M = 1. The probability of error is upper bounded by 

PS <Pr(£ [1] ) + Pr(£ [2] ) (17) 

for all k G {l,--- , K}. 

Proof: The proof is in Appendix I. ■ 
From the previous lemma, the probability of error can be arbitrarily small if both Pi(E^) and Pr(E^) tend to 
zero as n increases. In essence, although T^(Hi) is random, by the weak law of large numbers, we can bound 
|rI b ](Hi)| and make both Pr(E^) and Pt(E^) tend to zero as n — > 00 by appropriately setting the value of 
n(Hi). From the definition of n(Hi), this is equivalent is to determining the symmetric rate R that guarantees 

(n) 

P e k — > as n — > 00. The following theorem characterizes such R. 



Theorem 2: Suppose a linear finite-field relay network with M = 1. Then for any 5 > 0, 

1 
2 



Rk = \ E nun{Pr(Hi),Pr(Hi +!)}-<* (18) 



HieF. 



KxK 



is achievable for all k G {1, • • ■ , K}. 

Proof: Let us consider |Tt b ](Hi)|. By the weak law of large numbers [30], there exists a sequence e n — > 
as n —> 00 such that the probability 

|TW(Hi)| > ^(Pr(Hi) - S n ) for all H x (19) 

is greater than or equal to 1 — e n , where 5 n — > as n — >• 00. This indicates that Pr(E'W) < e n if n(Hi) < 
§(Pr(Hi) - S n ) for all Hi. Similarly, Pr(£t 2 l) < e n if n(Hi) < §(Pr(Hi + I) - S n ) for all Hi. Hence, from 

O and P^k ^ 2e « if 

R < — — <5„ (20) 

~ 2 2min{Pr(Hi),Pr(Hi +1)} 

for all Hi. Thus we set R = ^ — 5* n , where <5* = 2min H {Pr(Hi)} ^"' which tends to zero as n —>■ 00. In conclusion, 

R = \ minlPrQHiXPrOHi+I)}-^ (21) 
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is achievable for all k. Since R is the symmetric rate for all S-D pairs and <5* — > as n — > oo, Theorem [2] holds. 

■ 

Corollary 1: Suppose a linear finite-field relay network with M = 1. If pk,k,i = 1/2 for all k G {1, • • • , if}, 
the capacity region is given by all rate tuples (R%, ■ ■ ■ , Rk) satisfying 

Rk < \ (22) 

for all fc G {1, • • ■ 

Proo/- Since Pr(H x ) = Pr(Hi + I) for all H x if p fc(fc)1 = 1/2, from (ED, 

R=\ ]T P*(Hi)-S*n = l-S*n (23) 

is achievable for all k. From the fact that <5* — > as n — > oo, the achievable rate region asymptotically coincides 
with the upper bound in (fT2l . which provides the capacity region. Thus, Corollary Q] holds. ■ 

Remark 1: The result of Corollary Q] can be directly extended for q-ary case in which inputs, outputs, and 
channels are in ¥ q , if the channels are uniformly distributed over ¥ q . Specifically, the capacity region is given by 
all rate tuples (Ri, • • • , Rk) satisfying Rk <\ log q for all k G {1, • • • , K}. 

Corollary Q] shows that the sources can transmit simultaneously to their destinations at a rate of the point-to-point 
communication assuming no interference if the direct channels are uniformly distributed. This result also shows 
that, in the case of multi-source one-hop networks, the max-flow min-cut theorem holds for a certain class of 
channel distributions. Similar to the result of Gaussian one-hop networks in [28] where 1/2 degrees of freedom is 
achievable for each S-D pair, each source can transmit data to its destination with a non-vanishing rate even as K 
tends to infinity. 

V. ACHIEVABILITY FOR MULTI-HOP NETWORK 

In this section, we propose a transmission scheme for multi-hop linear finite-field relay networks and derive an 
achievable rate region. As mentioned in Introduction, due to the time-varying nature of wireless channels, each 
source can transmit one bit to its destination without interference through particular instances from Hi to if 

HmH m _ x • • • Hi = I. (24) 

The block Markov encoding and relaying structure makes a series of pairing from Hi to Hm possible. We first 
show an example 2-2-2 networks and then extend the idea to general multi-hop networks. The abbreviations used 
in this section is given by Table HI 

A. 2-2-2 Networks 

Let us consider 2-2-2 networks with Pj^ m = 1/2 for all i, j, and m. There are 16 possible instances for each 
Hi[i] and Ha[t], which are uniformly distributed. For each time t, if information bits are transmitted through Hi[i] 
and H 2 [i + 1], there exist 256 possible instances from Hi[i] to H 2 [i + 1] and 

177 

R sum = E(rank(H 2 H 1 )) = — (25) 

256 

is achievable. Notice that the achievable sum-rate is less than that of the single-hop case since E(rank(H2Hi)) < 1, 
which is achievable for 2-2 networks. 

However, we can achieve a sum-rate higher than and also higher than the single-hop case by appropriately 
pairing Hi and H 2 . Fig. [5] illustrates the deterministic pairing of Hi and H 2 and related encoding and relaying. 
The dashed lines and the solid lines again denote the corresponding channels are ones and zeros, respectively. The 
symbols in the figure denote the transmit signals of the sources and the nodes with no symbol transmit zeros, where 
Sk denotes the information bit of the /c-th source. Then 

R sum = E(rank(H 1 )) = ^ (26) 

16 

is achievable, which coincides with the cut-set upper bound in ( fT3l . Thus, this simple scheme achieves the sum 
capacity. 
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Based on the deterministic pairing in Fig. [5J we can characterize the sum capacity for more general channel 
distributions as shown in the following theorem. We will explain the detailed block Markov encoding which allows 
pairing between particular instances possible in the next subsection. 

Theorem 3: Suppose a linear finite-field relay network with M = 2 and K\ = K 2 = K% = 2. Then we can 
characterize sum capacity for the following cases. 

1) For a symmetric channel satisfying V\,\,\ = P2,2,i = Pi, 1,2 = P2,2,2 and pi )2 ,i = p 2 ,i,i = Pi, 2, 2 = P2,i,2 or a 
Z channel satisfying p 2 ,i,i = P2,i,2 = 0, pi,i,i = pi,i,2. Pi,2,i = Pi,2,2, and p 2 ,2,i = P2,2,2, the sum capacity 
is given by 

C sum = E(rank(Hi)). (27) 

2) For a Z channel satisfying p 2 ,i,l = P2,i,2 = 0, pi,i,i = p 2) 2,2. Pi,2,i = Pi,2,2, and p 2 ,2,i = Pi, 1,2, the sum 
capacity is given by 

__ jE(7i2,2,l) +E(/ti j i )2 ) if Pl,l,l > p 2 ,2,l 98 
[E{hixi) + E(/t 2)2 ,2j if Pi, 1,1 < P2,2,l, 

Proof: Let us first derive the achievable sum-rate by using the deterministic pairing in Fig. [5] Let to p™ 6 ' 
denote 16 possible instances of H m [t] as shown in Fig. |6j where m € {1,2}. In general, the probabilities of Hi 
and H 2 in each pairing in Fig. [5] are not the same. However, we can construct nmin{Pr(Hi), Pr(H 2 )} pairs for 
each pairing during a length-n block. Thus the achievable sum-rate is given by 

^ sum = E nnn{p« p«} + ™Hp?\p?} + min{^,^} 

ie{2,4,6,9,ll,13,16} 

+ 2 J2 m.m{p { i\p^} + 2mm{pf\p { 2 5) } + 2mm{pj 15) ,p 2 8) }. (29) 

iG{7,10,12,14} 

Let us now consider the first case in which the probabilities of Hi and H 2 in each pairing are the same. Then, 
from (El), 

R sum = E Pi ) + 2 E Pi =E(rank(Hi)). (30) 

iG{2,3,4,5,6,9,ll, 13,16} iG{7,8,10,12,14,15} 

Since the achievable sum-rate coincides with the sum-rate upper bound in ( fT3T ), it characterizes the sum capacity. 
Now consider the second case. Because P2,i,m — 

0, there are 8 possible instances of H m [i]. Unlike the first 
case, the probabilities of Hi and H 2 in each pair in Fig. [5] are not the same. Let us denote p a = pi^i = P2,2,2 ; 
Pb = Pi,2,i = Pi,2,2, and p c = p 2 ,2,i = Pi, 1,2- For p a > p c , from dH, 

i? sum = P? + P? + pT + pT ] + 2Pi 10) + 2pi 14) 

= (1 - Pa)(l - Pb)Pc + (1 - Pa)PbPc + (1 - Pa)(l ~ Pb)Pc + (1 ~ Pa)PbPc 
+ 2p a (l - p b )p c + 2p a p b p c 

= 2 Pc = E(h 2X1 ) + E(h 1X2 ). (31) 
r i t 

If we consider f2i in Fig. |7j i? sum <E(rank( [/i2, 2 ,i,0] r ,[0,/ii i i i 2] T ) ) = E(/i 2 ,2,i) + ^1,1,2), which coincides 



with the achievable sum-rate. Similarly, for p a < p c , from 

^sum = pf +pf+P? +pi 13) + 2pi 10) + 2pl 14) = E(h hljl ) +E(/ i2 ,2, 2 ). (32) 

If we consider Sl 2 and $^3 in Fig. |7J R\ < E(/ii i i i) and i? 2 < E(/i 2 2i2 ), respectively. Then i? SU m < E(/ii 5 i i) + 
E(/i 2 2 2 ), which coincides with the achievable sum-rate. In conclusion, Theorem |3] holds. ■ 



B. General Multi-hop Networks 

In this subsection, we study the achievabiliy for linear finite field relay networks when M > 2 and p/^m = p 
for all i, j, and m. We assume that the considered network has a minimum-dimensional bottleneck-hop and derive 
a symmetric rate region, that is R\ = ■ ■ ■ = Rk- 

If a series of pairing from Hi to Hju satisfies the condition ((241) . each destination can receive one bit without 
interference. But if some instances are rank-deficient, we cannot find such pairs by using these rank-deficient 
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instances. Furthermore, the number of possible pairs increases exponentially as the number of nodes in a layer or 
the number of layers increases. Even for 3-3-3 networks, we should consider 2 3x3 times 2 3x3 possible candidates. 
Thus, instead of constructing deterministic pairs for all instances, we randomize a series of pairing such that H m 
is paired with one instance at random in a subset of H m+ i's. 

1 ) Block Markov encoding and relaying: The proposed scheme divides a block into B + M — 1 sub-blocks 
having length ns for each sub-block, where ns = b+m-i - Since block Markov encoding and relaying are applied 
over M hops, the number of effective sub-blocks is equal to B. Thus, the overall rate is given by b+m-i ^' wnere 
R is the symmetric rate of each sub-block. As n — > oo, the fractional rate loss 1 — B+ f I _ l will be negligible 
because we can make both re# and B large enough. For simplicity, we omit the block index in describing the 
proposed scheme. 

2) Balancing the average rank of each hop: Recall that the m-o-th hop becomes a bottleneck for the entire 
multi-hop transmission, which can be seen from the sum-rate upper bound in (TOl ). As an example, consider 3-2- 
2-3 networks in which the second hop becomes a bottleneck. If each source transmits at a rate of iE(rank(Hi)), 
then it will cause an error at the second hop. To prevent this error event, the rate of each source should be decreased 
to -^E(rank(H mo )). For this reason, we select V m ,tx[i] != Kn and V m>rx [i] Q V m +i randomly such that 

[t]) € V(K mo ,K mo+1 ,V m ,V m+1 ) (33) 

with equal probabilities (or in V(K mg+ i, K mo , V m , V m +i)). For each time t, only the nodes in V m ,tx[t] and V mirx [t] 
will become active at the m-th hop. Notice that since the considered network has a minimum-dimensional bottleneck- 
hop, it is possible to construct such V m>tx [t] and V TOr xM- I n me case °f 3-2-2-3 networks, only the nodes in Vi t x [t] 
and Vi >rx [£] satisfying (IVi^xMI, |Vi,rx[i]|) = (2, 2) become active at the first hop. The same is true for the last hop. 
Whereas the whole nodes in V2 and V3 become active at the second hop, that is V2,tx[*] = V2 and Vz rxM = ^3- 

The following lemma shows the probability distribution of Hy m r t iy m which will be used to derive the 

achievable rate region of general multi-hop networks. 

Lemma 2: Suppose a linear finite-filed relay with Pj^ m = P for all i, j, and m. If the network has a minimum- 
dimensional bottleneck-hop, then 

Pr(H Vm M[t]>Vm ix[t] [t] = H) = p u (l - p f ma ^K mo -u^ (34) 

where u is the number of zeros in H. 

Proof: The proof is in Appendix II. ■ 
The probability distribution of Hy m m y m m [t] is the same as that of H mo [t], which is the channel matrix of 
the bottleneck-hop. Thus if only the nodes in V OT ,tx[t] and V mirx [i] are activated at the m-th hop, each hop can 
deliver information bits that are sustainable at the bottleneck-hop. 

3) Construction of sets of transmit and receive nodes: Because the maximum number of bits transmitted at the 
m-th hop is determined by rank(Hy m t M,y TO w [t]), we further select V m ,tx[t] ^ V m ,txM an d Vm,rx[i] ^ V ?w>rx [t] 
randomly such that 

(Vm,txM, Vm,rxM) G V(H Vm tx[t]iVm ,„[*] [t]) (35) 

with equal probabilities. For each time t, the nodes in V mj tx[i] transmit and the nodes in V mirx [i] receive through 
the channel H v t ^ v m «[t]M at tne m " tn h°P- Then, as we will show later, information bits can be transmitted 
using particular time indices ti, ■ ■ ■ ,tM such that 

which guarantees interference-free reception at the destinations. One of the simplest ways is to set H Vi t [ t j Vi ^ [t] = 

••• = H V J #_i, te [t],Vv-i,«[t][ t ] = G and H VM, te W,VM,«[t]M = (G M-1 ) _1 . It is possible to construct those pairs 
because the resulting Hy m t My m „[t] M ^ s a l wa Y s invertibleQ There is no rate loss by using ( V m ,t x [t] , V mirx [t] ) 
instead of using (V m ,tx[t], V m , rx [t]) because rank(H Vmtjc[t j )Vm txM [t]) = rank(H Vm tx ^ iVm ,«[*][*])• 

The following lemmas show the probability distributions related to H v t ^ Vm r ^ [f] , which will be used to 
derive the achievable rate region of general multi-hop networks. 



3 We ignore the instances having all zeros, which give zero rate. 
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Lemma 3: Suppose a linear finite-field relay network with Pj,i, m = p for all i, j, and m. If the network has a 
minimum-dimensional bottleneck-hop, then for rank(G) = r ^ 0, we obtain 

Pr(Hv mttxW ,v_ M W = G)= E E (37) 

(V,V')£ He«£ (G,V',V») ^ ;| 

V(r,r,V mo ,V mo + 1 ) 



Pr(H W(Jiik ^ [t] = G) = W? 1 (39) 



where Pr(H) is given by (1341) . 

Proof: The proof is in Appendix II. ■ 
Lemma 4: Suppose a linear finite-field relay network with Pj i m = p for all i, j, and m. If the network has a 
minimum-dimensional bottleneck-hop, then for rank(G) = r ^ 0, we obtain 

Pr(H^ tx[t]i y m rx[t] [t] = G, V mM [t] = V m , V m>IX [t] = V m+1 ) = Z^Ly (3 § ) 

where Pr(G) is given by 071 ). 

Proof: The proof is in Appendix II. ■ 
Based on Lemma |3l we derive Pr(G) when Pj i m = 1/2. The important aspect is that the resulting Pr(G) is a 
function of rank(G). 

Lemma 5: Suppose a linear finite-field relay network with pj.i.m = 1/2 for all i, j, and to. If the network has a 
minimum-dimensional bottleneck-hop, then for rank(G) = r ^ 0, we obtain 

N Kmo+1 , Kmo (r) 
N r , r (r) 

where N a ^(i) is the number of instances in F^* 6 having rank i. 

Proof: The proof is in Appendix II. ■ 
4 ) Encoding, relaying, and decoding functions: In this part, we explain the encoding, relaying, and decoding 
scheme based on V m ,t x [t] and V msx [t]. Let us define T m (G, V' m , V m+1 ) as the set of time indices of the sub-block 
at the m-th hop satisfying Vtx,mM = V' m > Hx,mM = Vm+l> and ■^■V^,V^ +1 M = G, where m G {1, • • • , M}. We 
further define 

n(G) = n Bj Rmin{Pr(G),Pr((G M - 1 )- 1 )}c 2 " 1 , (40) 
where ^ 

C 2 = ^E* E min{Pr(G),Pr((G M - 1 )- 1 )}. (41) 

»=i GeF* x \ 

rank(G) = i 

Each source will transmit J2g rank(G)re(G) bits during ng channel uses. From (l40b and (|4TT> . we can check 
that R is equal to £) G rank(G)n(G). 

Let us consider the detailed encoding and relaying procedure. For all full-rank matrices G G UjJ^ n F l ^ <i , the 
encoding and relaying are as follows, where r = rank(G) and for simplicity we assume n(G)/(( m )^ m + 1 )) is 
an integer. 

• (Encoding) 

For all (V(,V£) G V(r,r, Vi, V 2 ), If |7i(G,V{,V0| < n(G)/((^ 1 )( i ^ 2 )) declare an error, otherwise each 
source in V[ transmits n(G) / (( Kl ) ( K2 )) information bits using the time indices in 7{(G, V[, V 2 ) to the nodes 
inV 2 . 

. (Relaying for m G {2, ■ • ■ , M - 1}) 

For all (V m ,V m+1 ) G V(r,r,V m ,V m+1 ), if |T m (G, V^, V' m+1 )\ < n(G) / (( K -)( K ^)) declare an error, 
otherwise each node in V' m relays n(G)/(( K ™) ( K ™ +1 )) bits using the time indices in T m (G, V' m , V' m+ i) to 
the nodes in V' m+ 1, where the transmit bits are constructed by evenly allocating the received bits that arrive 
from difference paths. 

• (Relaying for m = M) 

For all (y' M ,V M+1 ) G V(r,r,V M ,V M+1 ), if \T M {{G M - l )-\V M y M+1 )\ < n(G)/(( K r M ) declare an 

error, otherwise each node in relays re(G)/(( M ) ( K *l +1 )) bits to the destinations in V' M+1 using the time 
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indices in Tm{(G m 1 ) 1 , V' m , V'm+i)- The n °des in V' M relay all received bits that originated from V[ to the 
nodes in V' M+1 , where V{ is the set of the corresponding sources of the destinations in V' M+l . 
Let Sk(i) denote the i-th information bit of the k-th source and denote the time index that the received 

signal at the m-th hop originated from Sfc(i), where i € {1, • • • , 2 UbR }. That is, Sk(i) is transmitted using the time 
indices ifc,i(i) to tfc.w(i) during the multi-hop transmission. The detailed decoding of the A>th destination is as 
follows. 



For i € {1, • • • ,ubR}, set §k(i) = Vk,M[tk,M (&')]• Then estimate W~k based on nRk estimated bits. 

Fig. [8] illustrates the encoding and relaying of 3-3-3-3 networks when G = [[1, 1] T , [0, 1] T ] T . The nodes 
represented as filled circles at the m-th hop denote the nodes belonging to V m ,t x [£] or V m , rx [i], where the chan- 
nel between V m ,t x [i] and V m , rx [*] are oniV denoted in the figure. If we assume \Ti(G, V[, V 2 )\ > n(G)/9, 
|T 2 (G,V^,V^)| > n(G)/9, and |T 3 ((G 2 )- 1 , V 3 , V 4 )\ > n(G)/9, then we can prove that rank(G)n(G) bits can 
be delivered using the time indices in these sets. The formal proof including how to determine the value of n(G), 
equivalently R, that makes pj —> as n# — > oo will be shown in the next subsection. 

Let us focus on the transmission from the sources in {i*i,i, 1*2,1} to the corresponding destinations in {1*1,4, ^2,4}- 
At the first hop, each source in {y\ \,V2 \} transmits n(G)/9 information bits each to the nodes in {1*1,2, ^2,2}, 
{«i,2, ^3,2}, and {^2,2,^3,2} using the time indices in 75, (G, {^i,i,u 2l i}, {v 1}2 , v 2>2 }), 7i(G, {1*1,1, v 2 ,i}, {1*1,2, ^3,2}), 
and 7i(G, {1*1,1,1*2,1}, {^2,2,^3,2}), respectively. Then, at the end of the first hop, the nodes in {1*1,2,1*2,2} receive 
n(G)/9 bits each from the sources in {11,1,1*2,1}, {«i,i, tfyi}, and {1*2,1, ^3,1}- The same is true for {1*1,2,^3,2} 
and {1*2,2, ^3,2}- 

Let us now consider the second hop. Each node in {1*1,2, 12,2} relays the received bits to the nodes in {1*1,3, 1*2,3}, 
0>i,3) «3,3}. and {1*2,3, ^3,3} using the time indices in T 2 (G, {1*1,2, ^2,2}, {^1,3,^2,3}), T 2 (G, {v h2 , v 2>2 }, {1*1,3, ^3,3}), 
and 72(G, {1*1,2,^2,2}, {^2,3, 1*3,3}), respectively. Note that each node in {1*1,2,1*2,2} construct n(G)/9 transmit bits 
to be delivered to {1*1,3,12,3} by evenly choosing the received bits that originated from {1*1,1,^2,1}, {1*1,1,1*2,1}, 
and {1*1,1,1*2,1}- The transmit bits to {1*1,3,1*3,3} and {1*2,3,^3,3} are constructed by the same manner. Similarly, the 
nodes in {1*1,2,^3,2} and {1*2,2,^3,2} transmit their received bits. 

Then at the last hop, the destinations in {1*1,4,1*2,4} should collect all received signals that originated from the 
sources in {1*1,1, 1*2,1}- This can be done since at the end of the second hop, each node in {11,3, 12,3} receives n(G)/9 
bits that originated from the sources in {1*1,1,1*2,1}, which is less than ^((G 2 ) -1 , V 3 , V^)) from the assumption. 
Hence, each source in {1*1,1,1*2,1} can transmit n(G)/3 bits to the corresponding destinations in {1*1,4, ^2,4}- Because 
the same number of bits are transmitted from {1*1,1,1*3,1} to {1*1,4,1*3,4} and from {1*2,1,^3,1} to {1*2,4,1*3,4}, we 
can deliver rank(G)n(G) bits by using the time indices such that H-p^™ v mr Jt]M = G for m = {1,2} and 



C. Achievable Rate Region 

In this subsection, we derive an achievable rate region by applying the proposed block Markov encoding and 
relaying. We first show in Lemma [6] that each destination can receive information bits without interference if there 
is no encoding and relaying error. Then in Theorem [4] we obtain the value of R that makes the probabilities of the 
encoding and relaying errors arbitrarily small. 

For m G {1, • • • , M — 1}, let E m denote the event such that 



• (Decoding) 



H 



■v 3 ,tx [t],v 3 , rx MW - ( g2 ) • 



\%n(G,V m ,V m+ i)\ < R ^ K m+1 
lrank(G)J Vrank(G) 

for any V' m , V' m + \, and G. Similarly, let Em denote the event such that 




(42) 



for any V' M , V' h 



M+l 




(43) 
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< E P ^ E m) (44) 



Lemma 6: Suppose a linear finite-field relay network having a minimum-dimensional bottleneck-hop with M > 2 
and Pj t i t m = P for all i, j, and m. The probability of error is upper bounded by 

M 

,(n B ) 

m=l 

for all k € {!, ■■■ ,K}. 

Proof: The proof is in Appendix I. ■ 
Then the remaining thing is to derive the symmetric rate R that guarantees P^u — » as — > oo. The 

following theorem characterizes such i?. 

Theorem 4: Suppose a linear finite-field relay network with M > 2. If the network has a minimum-dimensional 

bottleneck-hop and Pj^ m = P f° r au *» j» an d m > trien f° r an Y £ > 0, 

Rk = ^^i E min{Pr(G),Pr((G M - 1 )- 1 )}-,5 (45) 

i=i GeF* xi , 

rank(G) = i 

is achievable for all k E {1, • ■ ■ where Pr(G) is given by d37l ). 

Proof: Let us first consider |7^(G, V^, V^ +1 )|, where r = rank(G). By the weak law of large numbers 
[30], there exists a sequence e riB — > as ng — > oo such that the probability 

|T m (G,V^,l/ m+1 )| >n B (Pr(G,V^V^ +1 ) + «5 nfl ) (46) 

for all G, V' m , and V' m+1 is greater than or equal to 1 — e n , B , where <5„ B ^OasriB^oo. This indicates that, for 
me {!,-■■ ,M-1}, Pr(E m ) < e„ B if 

n(G) < n B (pr(G) - (^r 1 )^) (47) 

for all G. Note that we use the fact that Pr(G, V m , V m+1 ) = Pr(G)/((^ r m ) ( Km r +1 )). Similarly, Pr (Em) < e nB if 



n(G) < n B (ft ((G"" 1 )- 1 ) - ( K ^j 



(48) 



for all G Then, < Me n if <g7) and (gg) hold for all G This condition can be satisfied if 



R < co c 2 (if max !) 2 <5 nB 

- 2 min{Pr(G),Pr((G M - 1 )- 1 )} ^ ; 

for all G, where we use the definition of n(G) in <@0|> and the fact that < K ma J. Thus we set R = c 2 - 5* B , 
where <5* B = min { P ^ (g^ pT('(&" - 1 ) - 1 ) } ■ wrnc h tends to zero as ng — > oo. In conclusion, we obtain 

R =^J2 i T, min{Pr(G),Pr((G M - 1 )- 1 )}-^ (50) 

*=iGeF* xl , 

rank(G) = i 

is achievable. Since R is the symmetric rate and 5* B -> as ng -> oo, Theorem @] holds. ■ 
Now let us consider the capacity achieving case. If Pr(G) = Pr((G M - 1 )~ 1 ) for all possible G, then the 
achievable sum-rate in Theorem [4] will coincide with the upper bound in ([T3l . When the channel instances are 
uniformly distributed, the above condition holds and, as a result, the sum capacity can be characterized. The 
following corollary shows that the sum capacity is given by the average rank of the channel matrix of the bottleneck- 
hop when p = 1/2. 

Corollary 2: Suppose a linear finite-field relay network with M > 2. If the network has a minimum-dimensional 
bottleneck-hop and Pj^ m = 1/2 for all i, j, and m, the sum capacity is given by 

0^ = 2-^0+^0 rank(H). (51) 
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Proof: Consider the case that Pj^ m = 1/2- Then, from d39l ), Pr(G) is a function of rank(G). Since G and 
(QAf-l)-l haye the same rank) p r (Q) = Pr((G A/_1 ) _1 ) for all possible G. Hence ([50]> is given by 



»=1 GGF* xi , 



if 



rank(G) = i 



K"min 

E iN K mo+u K mo ii) ~ S* 



1=1 



K- Kmo+1 K mo rank(H)-C, 



if 



(52) 



where we use the fact that ^GeF 4xi rank(G)=i 1 = ^»,»(*) an( ^ <l39b for the second equality. Since 5* s — > as 
ub —> oo the achievable sum-rate iti? asymptotically coincides with the upper bound in (fl"3l . which completes the 
proof. ■ 

Remark 2: The result of Corollary |2] can be directly extended for g-ary case in which inputs, outputs, and 
channels are in ¥ q . Specifically, the sum capacity is given by C sum = q- K ™o+ lK ™o X) HgF K mo+i xKm o rank(H) logg. 

Notice that Corollary |2] shows that the sum-rate of E(rank(H mo )) is achievable, that is the multi-input multi- 
output (MIMO) capacity of the bottleneck-hop. This result also shows that, in the case of multi-source multi-hop 
networks, the max-flow min-cut theorem holds for a certain class of channel distributions and network topologies. 

Fig- dO]plots sum-rates of two-hop networks, where we assume a linear finite-field relay network with Pj i m = p. 
For 2-2-2 networks, the sum capacity is given by C sum = ^PQ 3 + 8p 2 q 2 + 8p 3 q + p A , where q = 1 — p. Notice 
that the considered channel distribution is a special case of the symmetric channel in Theorem [3] Therefore, we 
can characterize the sum capacity for all p E [0, 1]. For 3-3-3 networks, we obtain C sum > 9pq 8 + 54p 2 q 7 + 
168pV + 279pV + 216p 5 q A + 72\p 5 q A - p 6 q 3 \ + 216min{pV,pV} + 90p 6 q 3 + 90p 7 q 2 + I8p 8 q + p 9 and 
Csum < 9pq 8 + 5ip 2 q 7 + 168pV + 279pV + 324p 5 g 4 + 198pV + 90p 7 q 2 + I8p 8 q + p 9 . The lower and upper 
bounds are the same when p = \, which coincides with the result of Corollary [2] (if p = or 1 the lower and 
upper bounds are trivially the same). 



VI. Conclusion 

In this paper, we studied fading linear finite-field relay networks, which exhibit broadcast, interference, and fading 
natures of wireless communication. Capacity characterization of such relay networks with multiple S-D pairs is quite 
challenging because the transmission of other session acts as inter-user interference. One of the main interests will 
be the possibility of the extension of the max-flow min-cut interpretation to the multi-source problem. We observed 
that the fading can play an important role in mitigating interference that leads to the capacity characterization for 
some classes of channel distributions and network topologies. For these classes, we showed that the capacity region 
of single-hop networks and the sum capacity of multi-hop networks can be interpreted as the max-flow min-cut 
theorem. 



Appendix I 

Upper Bound on the Probability of Error 

Proof of Lemma [7]- Let us assume that U E^) c occurs. From the assumption, each source can transmit 
n(Hi) bits using the time indices in |TM(Hi)| and |Tt 2 ](Hi)|, respectively. 

Then consider the estimated bit Sf,(i) at the k-th destination. Since the effective channel matrix after adding two 
received signals is given by 

Hi[ti(i)]+Hi[t 2 (i)] =1, (53) 

we obtain §k(i) = Sfc(i). Hence there is no error if (E^ U E^) c occurs. In conclusion, from the union bound, we 
obtain < Pr(^W) + Pr(£l 2 ]), which completes the proof. ■ 
Proof of Lemma® Let us assume that (U^l =1 E m ) c occurs. From the assumption, for m E {1, • • • , M — 1}, 
each node in V' m can transmit ™(G)/(( ra ^w* G N) (^wgo)) to ^ e no( ^ es m Kn+i usm g the time indices in 
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%n(G,V' m ,V' m+1 ). Similarly each node in V M can transmit n(G) / ((J£fa) ( r ^ } )) bits to the nodes in V M+1 
using the time indices in 7^ l ((G M_1 ) _1 , V^, V^ /+1 ). 

For given G and V^, each node in receives n(G)/(^ m ) bits and then relays n(G)/((^ m ) received 
bits to the nodes in V^ +1 , where r = rank(G) and m £ {2, • • • , M — 1}. Since there exist possible V^ l+1 's, 

the total number of received bits is the same as the total number of transmit bits at each node in V' m . Thus each 
node in V' m can form n(G)/({ K ™) ( K ™ +1 )) transmit bits by selecting the same number of received bits that arrive 
from different paths, and then relays them to the nodes in V' n+1 . 

Let us now consider the last hop. Suppose that the nodes in V' M+l are the corresponding destinations of the 
sources in V[. Then, at the last hop, the nodes in V' M+l should receive all bits that originated from the sources 
in V{. Note that, for given G and V' M , the number of the received bits of each node in V' M that originated 
from V[ is given by n(G)/(( *)( M )). Thus, each node in V' M can relay these bits to the nodes in V' M+1 since 
n(G)/(( K ^)( K ™ +1 )), the number of bits able to transmit to V' M+1 is the same as n(G) / (( K r 1 ) ( K ^)) , where we 
use the fact that K = K\ = Km+i- 

Lastly, consider the estimated bit Sk(i) at the k-th destination. Since the overall channel matrix from Vtx,i[tfc,i(0] 
and Vrx,M[*fc,Af(*)] is g iven b Y 

H Vtx,M[t S! ,M(i)],V«,M[fa,M(j)] fo.Af (*)] • ' ' H -pt»,l[tfc,lW],"Pnc,l[*fc,lW] CO] = I > ( 54 ) 

we obtain Sk(i) = Sfc(i). Hence there is no error if (U^f =1 £' m ) c occurs. In conclusion, from the union bound, we 
obtain < Em=l Pr CEm), which completes the proof. ■ 

Appendix II 

Probability Distributions for Sub-channel Matrices 

Proof of Lemma\2\ We assume that |V mi t x [t]| = K mo and [V mr xM| = Km +i for the proof. But the same 
result holds for the case that |V m ,t x [*]| = Km a +i and |V m>rx [i]| = K mo . For a given H, we obtain 

Pr(H) ]T E Pr(H m )Pr(V , ,V"|H m )Pr(H|H m ,V , ,V") 

(V',V")e H m eFf m+1 * Km 



V(K mo ,K mo + 1 ,V m ,V m + 1 ) 



(a) 



(&) 



£ Pr(V',V") £ Pr(H m )Pr(H|H m ,V , ,V") 

(V',V")e H m eF 2 Km + lXKm 

V(Km ,K mo+ l,V m ,V TO+1 ) 

£ Pr(V',V") 2 Pr(H m ) 

(V',v)e H m eW Vm ,v m+1 (H,v,V") 

V(K mo ,K mo+1 ,V m ,V m+1 ) 



( =V(l-p)*"*+i*«o-« (55) 

where (a) holds from the fact that Pr (V", V"|H m ) = Pr (V", V") because V m ,t x [*] an d V mjrx [i] are chosen regardless 
of channel realizations, (6) holds since 

Pr(H|H m ,V',V") = | 1 ifH - eW v m ,v m+1 (H,V',V") (56) 
[0 otherwise, 

and (c) holds since Z)h,„g'H(h v V") P r (H m ) = p u (l — p^K mo+1 K mo -u^ Therefore, Lemma |2] holds. ■ 

Proof of Lemma \3} We assume that |V m ,tx[i]| = K mo and |V mjIX [i]| = K mo+ i for the proof. But the same 
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result holds for the case that |V m ,tx[*]| = K mo+ i and |V m ,rxMI = Km*, ■ For a given G, we obtain 

Pr(G) E E Pr(H)Pr(V', V"|H) Pr(G|H, V', V") 

HeFo 



(v,V")e - • ■ K "■■ 1 ' h 



where (a) holds since 



V(r,r,V m , t *[*],V m , ra [tI) 

= E E Pr(H)Pr(V',V"|H) 

fV',V")e hgw^ Vm rx[t] (G,v,V") 

V(r,r,V mitx [t],V m , rx [t]) 

(J V V Pr(H) 

(v.V'Oe HGH- mtx[t] , Vmrx[t] (G,v,V") |KV jl 

V(r,r,V m ,tx[t]>Vm,r»[t]) 

^ Y ^ Pr(H) 

^ ^ |V(H)I' K ' 

(v,V")e HeH£ (G,v,V") |Kl ;| 

V(r,r,V mo ,V mo + 1 ) 

Pr(G|H,W) = / 1 "H^^W.v^wfG.V'.V") (58) 
otherwise, 



(6) holds since Pr(V',V"|H) = if H £ w v mt x[t],v m „[t]( G ' V '' V ")' and ( c ) holds from the facts that 

Pr(H Vm tx [t]y m r Jt] [t] = H) is the same for all m, which is the result of Lemma[2j and |V(H Vm tx [t]y m w [t] = H)| 
is the same for all m. Therefore, Lemma [3] holds. ■ 
Proof of Lemma |?} From the definitions of Pr(G) and Pr(G, V' m , V' m+1 ), we obtain 

Pr(G)= E Pr(G,V,V") 

(V',V")eV(r,r,V m ,V m+ i) 

= ( K r)( K z +1 )^( G y m y m+ i) (59) 



where the second equality holds since \V(r, r, V m ,V m +i)\ = ( r m ) ( and Pr(G, V' , V") is the same for all V' 
and V". Thus, Pr(G, V^, V^ +1 ) = Pr(G)/ (( K r m ) ( Km r +1 )) > which completes the proof. ■ 
Proof of Lemma\5} Consider the case Pj,i, m = 1/2. Since rank(H-p m tx [t],v TO ^\t] M) = ran k(Hv m tx [t],v m t *M MX 
we obtain 

E Pr(G')= E Pr ( H )- ( 6 °) 

G'eFj' x r ' ,rank(G)=r' HgF2 K ™o+i«™« , rank (H)=r' 

From Lemma [2 we obtain 

Pr(H) = 2-^ m o+i^o ; (61) 
which is the same for all H. From Lemma |3j we obtain 

Pr(G') = 2-*-«-h*- E E tJ^SI- (62) 

(V',V")e He?f£ v (G',V,V") 1 v Jl 

V(rank(G'),rank(G'),V m() ,V mo + 1 ) " 

Then let us consider J^ueH^, v (G',V',V") |v(H)| • ^ e P rove the following two properties: 

1) £Hew£ m Vm+i (G,v,V") ]vm\ is the same for a11 V ' and V "- 

2) SiieWv v ( G ' v ' v ") |v(H) | * s tne same f° r a H G' having the same rank. 

To prove the first property, consider two (V' a , V") and (V' b , V' b '). Then we can find a row permutation matrix E row 
and a column permutation matrix E co i such that 

-Hv m ,v m+1 (G'XX) = {E row HE col |H e H^ Vm+1 (G', V' b , V b ')}. (63) 
Therefore, from the fact that |V(H)| = |V(E row HE co i)|, the first property holds. 
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Now consider the second property. Let us define r' = rank(G') 7^ 0. We assume that V' = {v i >m , • • • , v r ',m} and 
V" = {wi, m +l) ' ' ' , ^r',m+i} for the proof, but the same property can be easily derived for arbitrary V' and V" by 
using the first property. Fig. [9] illustrates the construction of Hy v (C, V, V"). We obtain r' x (if OT — r') matrix 
d = G'A, where A G ^' x ( x ™- r ')_ xhen (K m+1 - r') x iv" m matrix G 2 is obtained by setting G 2 = B[G', Gi], 
where B 6 F^"* -1-1 r ) xr . Therefore, we obtain 



^ miVm+i (G',V',V") = {[[G',G 1 ] T ,[G 2 ] 



T 



AGF r 2 x( ^- r,) ,BeFf- +1 - r,)xr ' 



}■ 



(64) 



Then for given A and B, |V( [G', Gi] T , [G 2 ] T )| is the same for all G' having the same rank. Therefore, the 
second property holds. 

From the above two properties, J2ueH^ v (C V V") |v(H)| * s ^ e same f° r au V'> V"> an( ^ having the 
same rank. We also know that |V (rank(G'), rank(G'), V m , V m +i) \ is the same for all G' having the same rank. 
As a result, Pr(G') is the same for all G' having the same rank. Thus, (l60l ) is given by 

Pr(G) ]T l = Pr(H) ^ 1. (65) 

G'eF^ x ^,rank(G')=r H eFf r 



Since £ G 'eF; xr ) n«lk(G')=r 1 = N rA r ) and £ R 



eF, 



E i. 

" lXKm °,rank(H)=r- 

"o W w\ 1 = N K mn+1 ,K m Ar), we finally obtain 

,rank(H)=r mo-t- L > m \ / 



PrfGl = 2- K ™ +lK ™ NKmo+uKm °^ 
{ ' N r Jr) ' 



(66) 



which completes the proof. 



References 

[1] T. M. Cover and A. El Gamal, "Capacity theorems for the relay channel," IEEE Trans. Inf. Theory, vol. IT-25, pp. 572-584, Sept. 
1979. 

[2] L. R. Ford Jr. and D. R. Fulkerson, Flows in Networks. Princeton, NJ: Princeton Univ. Press, 1962. 

[3] R. Ahlswede, N. Cai, S.-Y. R. Li, and R. W. Yeung, "Network information flow," IEEE Trans. Inf. Theory, vol. 46, pp. 1204-1216, 
July 2000. 

[4] S.-Y. R. Li, R. W. Yuung, and N. Cai, "Linear network coding," IEEE Trans. Inf. Theory, vol. 49, pp. 371-381, Feb. 2003. 

[5] R. Koetter and M. Medard, "An algebraic approach to network coding," IEEE Trans. Inf. Theory, vol. 11, pp. 782-795, Oct. 2003. 

[6] T. Ho, M. Medard, R. Koetter, D. R. Karger, M. Effros, J. Shi, and B. Leong, "A random linear network coding approach to multicast," 

IEEE Trans. Inf. Theory, vol. 52, pp. 4413^1430, Oct. 2006. 
[7] M. R. Aref, "Information Flow in Relay Networks," Ph.D. dissertation, Stanford Univ., Stanford, CA, 1980. 

[8] N. Ratnakar and G. Kramer, "The multicast capacity of deterministic relay networks with no interference," IEEE Trans. Inf. Theory, 

vol. 52, pp. 2425-2432, June 2006. 
[9] A. F. Dana, R. Gowaikar, R. Palanki, B. Hassibi, and M. Effros, "Capacity of wireless erasure networks," IEEE Trans. Inf. Theory, 

vol. 52, pp. 789-804, Mar. 2006. 

[10] B. Smith and S. Vishwanath, "Unicast transmission over multiple access erasure networks: capacity and duality," in Proc. IEEE 

Information Theory Workshop, Lake Tahoe, CA, Sept. 2007. 
[11] S. Ray, M. Medard, and J. Abounadi, "Random coding in noise-free multiple access networks over finite fields," in Proc. IEEE 

GLOBECOM, San Francisco, CA, Dec. 2003. 
[12] S. Bhadra, P. Gupta, and S. Shakkottai, "On network coding for interference networks," in Proc. IEEE Int. Symp. Information Theory 

(ISIT), Seattle, WA, July 2006. 

[13] A. S. Avestimehr, S. N. Diggavi, and D. Tse, "Wireless network information flow," in Proc. 45th Anna. Allerton Conf. Communication, 

Control, and Computing, Monticello, IL, Sept. 2007. 
[14] A. S. Avestimehr, S. N. Diggavi, and D. Tse, "Approximate capacity of Gaussian relay networks," in Proc. IEEE Int. Symp. Information 

Theory (ISIT), Toronto, Canada, july 2008. 
[15] R. H. Etkin, D. Tse, and H. Wang, "Gaussian interference channel capacity to within one bit," IEEE Trans. Inf. Theory, vol. 54, pp. 

5534-5562, Dec. 2008. 

[16] G. Bresler and D. Tse, "The two-user Gaussian interference channel: a deterministic view," in arXiv:cs. IT/0807. 3222, July 2008. 
[17] G. Bresler, A. Parekh, and D. Tse, "The approximate capacity of the many-to-one and one-to-many Gaussian interference channels," 

in Proc. 45th Annu. Allerton Conf. Communication, Control, and Computing, Monticello, IL, Sept. 2007. 
[18] W. Nam, S.-Y. Chung, and Y. H. Lee, "Capacity bounds for two-way relay channels," in Proc. IEEE International Zurich Seminar, 

Zurich, Switzerland, Mar. 2008. 

[19] A. S. Avestimehr and A. Sezgin and D. Tse, "Approximate capacity of the two-way relay channel: a deterministic approach," in Proc. 

46th Annu. Allerton Conf. Communication, Control, and Computing, Monticello, IL, Sept. 2008. 
[20] S. Mohajer, S. N. Diggavi, C. Fragouli, and D. Tse, "Transmission techniques for relay-interference networks," in Proc. 46th Annu. 

Allerton Conf. Communication, Control, and Computing, Monticello, IL, Sept. 2008. 



18 



[21] S. Mohajer, S. N. Diggavi and D. Tse, "Approximate capacity of a class Gaussian relay-interference networks," in Proc. IEEE Int. 

Symp. Information Theory (ISIT), Seoul, Korea, June/July 2009. 
[22] R. El Haddad, B. Smith, S. Vishwanath, "On models for multi-user Gaussian channels with fading," in Proc. 7th Int. Symp. Modeling 

and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt), Seoul, Korea, June 2009. 
[23] S.-H. Lim, Y.-H. Kim, and S.-Y. Chung, "Deterministic relay networks with state information," in Proc. IEEE Int. Symp. Information 

Theory (ISIT), Seoul, Korea, June/July 2009. 
[24] V. R. Cadambe and S. A. Jafar, "Multiple access outerbounds and the inseparability of parallel interference channels," in Proc. IEEE 

GLOBECOM, New Orleans, LA, Nov./Dec. 2008. 
[25] L. Sankar, X. Shang, E. Erkip, and H. V. Poor, "Ergodic two-user interference channels: is separability optimal?" in Proc. 46th Annu. 

Allerton Conf. Communication, Control, and Computing, Monticello, IL, Sept. 2008. 
[26] B. Nazer, M. Gastpar, S. A. Jafer, and S. Vishwanath, "Ergodic interference alignment," in Proc. IEEE Int. Symp. Information Theory 

(ISIT), Seoul, Korea, June/July 2009. 
[27] S.-W. Jeon and S.-Y. Chung, "Capacity of a class of multi-source relay networks," in Information Theory and Applications Workshop, 

San Diego, CA, Feb. 2009. 

[28] V. R. Cadambe and S. A. Jafar, "Interference alignment and degrees of freedom of the K-user interference channel," IEEE Trans. Inf. 

Theory, vol. 54, pp. 3425-3441, Aug. 2008. 
[29] V. R. Cadambe and S. A. Jafar, "Capacity of wireless networks within o(log (SNR)) - the impect of relays, feedback, cooperation and 

full-duplex operation," in arXiv:cs.IT/0802.0534, Feb. 2008. 
[30] I. Csiszar and J. Korner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic Press, 1981. 



19 



TABLE I 

Abbreviations used in SectionIvI 



Pr(H m ) 


Pr(H m [t] = H m ) 


Pr(H) 


Pr(H Vm , txW ,v m ,« M W = H) 


Pr(V',V" 


H m ) 


Pr(Vm,tx[t] = V, Vm,«[t] = V" H m [t] = H m ) 


Pr(H 


H m ,V',V") 


Pr(H Vm tx[t] . Vm « W [t] = H H m [i] = H m ,Vm,tx[t] = V',V m , rx [i] = V") 


Pr(V',V") 


Pr(V m ,tx[tJ = V,V m ,«[tJ = V") 


Pr(G) 


Pr(H Wtl ,v m , rx[t] [*J = G) 


Pr(V',V" 


H) 


Pr(V m ,tx[t] = V',V m , rx [i] = V" Hv m , teW ,v m , nt [t][t] = H) 


Pr(G 


H,V',V") 


Pr(H 9m tx[t] ,v m »[tlW = G H Vm tx[t] ,v m « W [*] = H,V m ,te[<] = V,Vm,«[t] = V") 


V(HJ 


V(H Vmite[t]iVmi „ w [tj = H) 


Pr(G,V',V") 


Pr(Hv ratxIt]l v m „ [t] [tJ = G,V TO ,tx[*J = V',V m , rx [t] = V") 




Fig. 1. Interference mitigation for the single-hop network (a) and for the two-hop network (b), where the dashed lines and the solid lines 
denote the corresponding channels are zeros and ones, respectively. 



(U)-lhnode (l,2)-thnode (l,3)-thnode (l,M)-thnode (1, M -M)-th node 

x \,\ ^i,i' x i,2 3^1,2 ' "^1,3 y\,u-\ ,x \M y^u 

(2,l)-thnode (2,2)-thnode (2,3)-thnode (2,M)-thnode (2,M +l)-th node 

• • • • • 

X 2,l y2,l' X 2,2 y%,%' X 2,i y2,M-\ ,X 2,M ^2,M 

first hop second hop M-thhop 

;=>;=>; ; => ; 

(K p l)^i node (K 2 ,2)4hnode (K 3 ,3)4hnode (K M , M )-th node (K M+1 ,A^+l)-th node 

^/f,,l' X X,,2 yr 3 ,2'*X 3 ,3 yK M ,M-1' X K M ,M ^m + i.M 



Fig. 2. Layered relay network. 




Fig. 3. Example of the cut-set bound 




Fig. 7. 2-2-2 relay network. 




1-st hop 2-nd hop 3-rd hop 



Fig. 8. Randomized pairing of Hi, H2, and H3. 
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Fig. 10. Sum capacity when Pj,i, m = p for all i, j, and m. 



